Distinguishing the communicative functions of gestures An experiment with annotated gesture data
نویسندگان
چکیده
This paper deals with the results of a machine learning experiment conducted on annotated gesture data from two case studies (Danish and Estonian). The data concern mainly facial displays, that are annotated with attributes relating to shape and dynamics, as well as communicative function. The results of the experiments show that the granularity of the attributes used seems appropriate for the task of distinguishing the desired communicative functions. This is a promising result in view of a future automation of the annotation task.
منابع مشابه
رشد ژست دراز کردن دست و عملکردهای ارتباطی آن در کودکان طبیعی از 8 تا 12 ماهگی: یک مطالعه ی طولی
Background and purpose: In developmental process, children use gestures for communication. One of these gestures is reaching which has various communicative functions. The purpose of this research was to investigate the development of reaching and its communicative functions in normally developed children aged 8-12 months whose language was Persian. Materials and methods: This longitudinal...
متن کاملHuman Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کاملThe NOMCO Multimodal Nordic Resource - Goals and Characteristics
This paper presents the multimodal corpora that are being collected and annotated in the Nordic NOMCO project. The corpora will be used to study communicative phenomena such as feedback, turn management and sequencing. They already include video material for Swedish, Danish, Finnish and Estonian, and several social activities are represented. The data are being annotated following an annotation...
متن کاملLabeling of Gestures in SmartKom - The Coding System
The SmartKom project is concerned with the development of an intelligent computer−user interface that allows almost natural communication and gesture input. For the training of the gesture analyzer, data is collected in so called Wizard−of−Oz experiments. Recordings of subjects are made and labeled off−line with respect to the gestures that were used. This article is concerned with the coding o...
متن کاملElectrophysiological and Kinematic Correlates of Communicative Intent in the Planning and Production of Pointing Gestures and Speech
In everyday human communication, we often express our communicative intentions by manually pointing out referents in the material world around us to an addressee, often in tight synchronization with referential speech. This study investigated whether and how the kinematic form of index finger pointing gestures is shaped by the gesturer's communicative intentions and how this is modulated by the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2008